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CONTINGENCY  TABLES  ARE  .POOLED* 

by 

** 

Chooichiro  Asano 
1.  Introduction  and  summary. 

In  certain  statistical  analyses  of  contingency  tables  on  genetic 
problems,  it  often  happens  that  we  have  to  estimate  probabilities  by 
appealing  to  combinations  of  observations.  In  such  a  situation,  how¬ 
ever,  false  associations  among  some  observations  due  to  the  pooling 
of  heterogeneous  groups  of  observations  have  caused  some  comment  by 
Batschelet  [3]  and  Li  [5]- 

To  simplify  the  statement  of  our  problem,  we  may  restrict  our¬ 
selves  to  a  special  subject  studied  by  Batschelet  in  [3]-  There,  a 
problem  is  proposed  where  the  question  arises:  Are  the  ages  of  onset 
for  two  siblings  stochastically  dependent  or  independent  for  special 
atopic  diseases?  To  explain  the  situation,  he  illustrates  a  spurious 
relationship  between  the  two  lots  of  siblings  by  a  very  obvious  model. 
Here  we  are  confronted  essentially  with  an  estimation  problem  of 
probabilities  on  the  basis  of  combining  sibs  of  different  registration. 

The  purpose  of  this  paper  is,  first,  to  formulate  the  basic  ideas 
and  to  work  out  the  combined  estimates  and  some  properties,  and,  second 
to  generalize  these  pooled  problems  related  to  various  contingency 
tables.  To  conclude,  the  author  justifies  the  validity  of  the  above 
criticism . 

*This  paper  was  written  while  the  author  was  a  Research  Associate  in 
the  Statistical  Laboratory,  Department  of  Mathematics,  The  Catholic 
University  of  America,  during  the  academic  year  1961-62. 

**This  study  was  aided  in  part  by  the  contract  NSF-9968,  National 
Science  Foundation,  in  part  by  the  contract  Nonr  2249(05),  (Nr  301-579). 
the  Office  of  Naval  Research,  Department  of  the  Navy  with  The  Catholic 
University  of  America. 
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2.  Formulation  of  the  problems  and  solutions. 


Suppose  that  the  first  individuals  of  a  population  can  be  described 
as  belonging  to  one  of  r1  categories  with  respect  to  an  attribute 
A  and  to  one  of  s^  categories  with  respect  to  an  attribute  B,  and 
the  second  individuals  can  be  truncatedly  observed  in  one  of  r^  in 


r  categories  for  A 

And  let  nf^  and  p 

J  i  J 


and  in  one  of  s^  in  s1  categories  for  B. 
be  the  independent  frequency  of  t-th  observa¬ 


tions  and  the  probability  in  the  i-th  for  A  and  j-th  for  B,  t=l,2. 
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Moreover,  to  simplify  the  case  in  general,  let  Q1  and  3  2  2  be 
the  first  observations  space  and  the  second  denoted  by  r^Xs.^  and 
r2xs2  respectively  and  let  njfc^  and  p  be  the  independent  fre¬ 
quency  of  t-th  observations,  t=l,2,  and  the  probability  defined  by 


-3- 


i  which  belongs  to  .Q  ,  and/or  Cc?  ,  where  R  Q  o  and  P  =  1 

^  1-2 


Then  the  likelihood  function  L  is  given  by 


(2.1) 


L  =  -ALAL 

TT<’!  TT<’|  n  ^  sly  X  If? 
s?,  ^  ^  u 


where  N1  =  7/°  and  ^i« 

1  *  :  ’ 

Under  these  circumstances,  we  obtain  the  following  theorems 
Theorem  1 ■  The  likelihood  estimates  of  the  pjs  are  given  by 


(2.2) 


fe  =  </n, 


(2.3)  ^=«-+<U(,+  ^)  ^ 

Sir  ,' 


T  (feft 


Proof.  The  likelihood  estimates  given  by  (2.2)  and  (2.3)  are  directly 
obtained  by  solving  the  normal  equations  and  using  the  invariant 
property  of  the  maximum  likelihood  estimation. 

Theorem  2 .  All  of  the  estimates  defined  by  (2.2)  and  (2.3)  are  un¬ 
biased  consistent  and  sufficient .  And  their  variances  and  covariances 
are  as  follows: 

(2.4)  V{f.j  =)?(! -to/rt,  Uft,-!?', 


(2.5)  V{pi)=  idiH+ia 
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(2.6) 

(2.7) 

(2.8) 

where 

size 

(2-5) 

(2.5) 

(2.7) 
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V  L4<b 


V 


e 


Q,~Q 


c 

z 


) 


C.v(Kf^ - V  , 

we  put  71,  =  71?  •  Moreover,  if  we  may  assume  that  the 

N2  is  sufficiently  larger  than  the  size  of  N1 ,  then,  from 
and  (2.7)j  we  obtain  the  following  asymptotic  relations. 


i  e  Qz  ? 


V  ;  i,}  *QZ  ^ 


* 
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Proof 

(f )  Unbiasedness.  Unbiasedness  of  ^  defined  by  (2.2)  is 
obvious  . 

To  show  that  (2.3)  defines  an  unbiased  estimate  we  study  the 
likelihood  function  (  2.1).  It  is  based  on  the  product  of  two  separate 
multinomial  distributions,  that  is,  one  ordinary  multinomial  distri¬ 
bution  and  a  conditional  multinomial  distribution,  and  is  essentially 


expressed  as  a  general  term  of  expansion  of  the  numerator  of 


Now,  from  this  viewpoint,  we  may  rewrite  the 


likelihood  function  as  follows: 


(2.9) 


£;<’}!  [2i< 

M  ^^2  V 


where  naturally 


ZZjj.'V 


IS  '  *  1  1  h  >  ~rr  i  ' 

tag  1’  7 
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Hence  the  expectation  of  |=  given  by  (2.3)  is  expressed  by 


<*•“>  E(U  =  : 


and  the  main  part  concerning  summations  becomes  equivalent  to  (2.10) 
in  case  we  put  and  .  And  we 


obtain 


(2.12)  EUtE  = 


L  =  4 . 


Variances  and  Covariances. 


To  prove  (2.4)  and  (2.6)  we  have  to  calculate  the  following 


expectations : 


(2.13)  ELVf* 


= 

k  Mi  Ni 


(2*14)  — 


and  we  obtain  immediately  (2.4)  and  (2.6)  since  each  ^  is  unbiased. 

In  order  to  get  (2.5)  and  (2.7)  we  have  to  apply  the  likelihood 
function  (2.9). 
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(2.15)  Elf] 


tojL. 


_  Nril  w2-  , 

N,  u  M 


— K  4-  ^:  zV.  y~-A^^  Jy-u  y-y, 


+  i__  i.y-  (V)  [ygV 

^  Hi  Nl  l-lJi-TI,  1  li.]  (E_ 

^  *  *  a . 


(2.16) 


N,l(M1+z:v>t 


ikil-iih  i 


itKi + turn 


LV) 


iMr1-*ni 


la^|inX ^  > 


and  YtVi-EftVf  ,V*5’  *J*&. 


The  result  given  by  (2.8)  is  obtained  by  applying  both  formulae 
(2.1)  and  (2.9)  in  the  following  way: 


L- 


(2.17) 


wvOM)  j ' 

N,  (  N^-v  ; 

O’  v  / 


where  L Q  denotes  a  formula  where  we  replace  with  N1~l  and 

Tl(?  with  7i"  —  1  at  ,  respectively,  and  then 

A 


(2-l8)  =  = 


N,-l 


nT~K1i 


i  '> 

where  denotes  a  formula  In  which 


substitute 


N*~2-  ;  2l7lc-l 

^  sir  L  1 


for  Nj  T  )>  ti1.0  and  >  71  ^  respectively.  Thus  we  obtain  (2.8)  from 

C ovCf; ^}  =  E tjl  —  •  This  covariance  is  obviously  inde¬ 

pendent  of  the  second  observations. 

(ill )  Consistency  and  Sufficiency.  Consistency  is  evident  since 
the  estimates  are  unbiased  and  the  variances  and  covariances  tend 
to  zero  if  1^-ico  .  Finally,  the  estimates  are  sufficient  because 
the  likelihood  function  can  b%  expressed  itself  as  a  function  of  para¬ 
meters  and  statistics. 


Theorem  3.  The  information  matrix  of  our  estimates  in  the  Fisher’s 


sense  is  given  by  the  following  elements: 
(2.19)  c;i  =  N,(-t - f~) 


-jw  0  ,  A  6-  CPl  A  ^  , 


(2.20) 


n. 


Nl  6  v  .  .  .  ,  .  r-^c 

fo  f  r  ’  lj*°>  Aje^ 


(2.21) 


a;j  =  -A 

h 


Nj _ l^Z 


(2 .22) 


V  7  L0  fe  ^ 


*  9- 


(2.3)  (j-'i  —  v')L  —  jj.  '^a  '  o  Q t  -  d 

where  pQ  belongs  to  ^  ^  and  Is  assumed  to  be  a  linearly 

dependent  probability  by  reason  of  ^~\>  =< .  And  the  estimates  are 

St  ^ 

inefficient . 


-;j  —  cv)L  _ 


Pg°°£ •  The  Information  matrix  is  obtained  by  the  ordinary  method, 

~  —  j.  And  inefficiency  is  obvious,  since  the 

variances-covariances  matrix  given  by  Theorem  2  cannot  attain  the 
inverse  Information  matrix. 

3.  Numerical  example. 

To  illustrate  the  above  formulation  and  results,  let  us  suppose 
the  following  ficticious  samples  with  regard  to  the  heredity  of  atopic 
disease.  There  are  72  pairs  of  siblings  with  an  atopic  disease  and 
they  are  classified  into  one  of  12  cells  each  assigned  to  the  inter¬ 
val  of  five  years,  in  Table  1.  Furthermore,  we  have  investigated 
99  pairs  of  atopic  children  which  belong  to  the  same  family  and  which 
are  nearly  of  the  same  age  at  their  onset  as  a  supplement  of  Table  1. 
They  are  classified,  as  in  Table  2,  into  one  of  4  cells  of  the  same 
scale  as  Table  1. 


X-^  --  the  age  of  onset  for  the  elder  sibling. 

—  the  age  of  onset  for  the  younger  sibling. 
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Now  let  the  probability  In  each  cell  be  denoted  by  p  with  suffix 
(T»j)  order  of  youth  1=1, 2, 3  and  j=l,2,3-4  •  Then  our  problem  Is 
to  estimate  each  p^.  by  combining  the  above  tables. 

Indeed,  the  estimates  are  calculated  as  follows: 


/\ 


(i-m 

t  =. 

U2  +  5-3)x2S 

$  ... 

15" 

b  _ 

(1  +  1 

*13  x(a* -t-i-n 

» 

7  3  X  fat  -t  41) 

M3 

03 

73  X 

U  +  5-i)X  2? 

£  - 

10 

K  — 

A- 

£  — 

3 

4.  <)<?') 

!*3 

•73 

hi 

T3 

132 

73 

‘1 

£ 

1 

i>  _ 

C  _ 

3 

■73 

4h  — 

73 

Ui 

ns 

73 

4.  Generalization  of  the  problem. 

Let  us  consider  the  combined  estimates  in  the  most  generalized 
case.  Suppose  uhat  Q-  ^“)  and  tp'  denote  the  i-th  sample  space  i=l,2,...,t 
a  probability  of  j-th  cell  in  Sc?;,  ,  and  a  mutually  independent  frequency  of 
the  1-th  observations  in  the  J-th  cell,  j=l , 2 ,  .  .  . ,k1 ,  respectively.  And 
assume  that  essentially  each  observation  space  is  at  least  partially 
associated  to  one  or  several  common  cells.  Furthermore,  we  put 

^  for  any  1  and  i.  ,  %  i/j  t,x/=  \,2.,  — ,  1z ,  without  a  loss  of 

generality,  since  we  may  make  afresh  by  means  of  combining  both 

i-th  and  i'-th  observations  in  case  Tor  some  i  i/  . 

Now  let  us  make  decompositions  (tol  of  0  such  as 


(4.1) 


u  =  i 


=  21  2Q: 

Y  ,i=<L 
’i  =>  o ,  1 

’<  5Tr<t 


where 


to, 


0  Tor  U.,Ul'=  I ,  v,  -  -  -y  2*- 


u  can  be  defined  for  arbitrary  i  as  follows: 


Then  the  suffix 


* 
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(4.2) 

U.  = 

1 

fa 

i  =  *  , 

(4-3) 

a  = 

il  A+  7 

T=  1 

fa 

>  £ , 

(4.4) 

4.nd 

&  =  1,2,3,  — , 

2*~L 

btrtk.  (4,2.)  OA%cL  (4,bJ) 

Let  p 

uv 

and  P^ 

be  a  probability 

of 

cells  in  C0u,  v=l,2,...,l 

Z-l  2-1 

and  fc,ir  ? where  ^  r=  \  Hence,  we  have  ^  ()  —  ^ 

V  I]  —  1  -  W. 

U  —  1 

parameters  to  be  estimated  and  we  may  and  now  shall  assume  p  is  a 

linearly  dependent  parameter,  since  the  maximum  likelihood  estimation  is 
Invariant. 

Under  these  circumstances,  we  obtain  the  following  theorem  in  a 
general  case. 

Theorem  4  The  combined  estimates  of  the  puv's,  u  =  1,2,..., 2^-1  and 
v  =  1,2,...  ,11^  ,  are  obtained  as  follows: 


(4-5) 


A 

L  = 


Wmii 


A  UvT  A 


"R  fa  U=  1,2,3, 


where 

A  A 

(4.6)  T.  =  1  -  > 

A  /\  /\ 

and  Pp,  Po,  ...,P  ,  are  obtained  as  solutions  of  2-2 
o  2t_1 


simultaneous 


equations  (4.7)  . 
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,  (4.7) 


~n.u.» 

—  "p 

i.  k  I  U. 

Ul 


=  0 


r  u  =  \ti, 


UlS?-T-Ou] 


and  where  we  put 


(^•S)  \^v]  =(m-j°|9.Duja9jj  ?  ntt.  = 


3_ _ ^-uv-  .. 

v=  i  ' 


M{=' 


<{> 

71 

J  > 


(4.9) 


Proof : 


{  ^UU)  )  —  [  '^ul  r\(^\  ^2l/)]D  °°u  f  1  ^  ^UU) -  V  ^U(i) 

r  >v-,r-_„  (->  vISolO^ 

Los  a:v<t  J 

The  likelihood  function  L  is  obviously  given  by 


(4.10) 


t  TT  Nl  '  t_  r 

L=  ^r— -r  IT  TT  ~4=rr< 

TT  TITfij  .«i  (jij.o  y  _  K 
1=1  3i^3r  ‘JJL 


V  J 


and  is  also  written  by  our  notations,  (4.8)  and  (4.9),  as  follows 


(4.11) 


T  CcTVot  TT 


{uI5?9^)  v-!  I  >  Tu 

WlS?pu)^ 


and  then  we  obtain 


(4.12) 


tlL 


\£—  ra 

>l2ou^ 


(4.13) 


-  n„ 


pIQpWu)  (  ^Uvr  Zl. _ Tu 
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While  the  likelihood  function  is  written  for  p's  as  follows: 


(4.14) 


L^^LfTTTp 

IT  IT  uJ  t=1  T 


and  then  we  obtain 


(4.15) 


T~  _ Nl l  ] 

fc.)  Ti  Hn  — 0  K 


'  ,3,- T-l, 


where  —  [  which  is  also  (4.7)  . 


Thus }  by  combining  bdth  (4.13)  and  (4.15)  ,  we  obtain  the  follow¬ 
ing  simple  formula  shown  in  Theorem  4. 


(4.16) 


A 

= 

\  u\r 


U\T  44. 


V-  u  =  A  ,  2,  5, - ,  2  -  j 


which  may  be  understood  intuitively  as  an  expected  relation.  (Q.E.D.) 

Generally,  to  obtain  the  solutions  'Ts,  u=2 , 3,  .  .  . ,  2t-l  ,  from  (4-7) 

o 

explicitly,  it  becomes  more  complicated  as  t  increases.  The  esti¬ 
mates,  however,  are  given  by  iterative  solutions  of  maximum  likelihood 
equations  in  the  following  way. 

Let  the  solutions  be  P  P  .  ,9  .  Suppose  that 

J  2-1 

P21’%1”  ’ ‘'p^2t_1  1  are  approximations  to  P2 ,  P3 ,  .  .  . ,  obtained 

in  any  manner;  the  easiest  procedure  will  be  to  apply  values  of 
a  rough  calculation  neglectJig  any  combination  of  observations  at  over¬ 
lapping  cells  and  using  temporary  values  of  the  first  observations. 
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Now  by  the  Taylor-Maclaurin  expansion,  to  the  first  order  of 
small  quantities,  improved  values  for  the  estimates  will  be 


(4a7)  TM  +  STf,  ,f=T?,  +  SK,,-,U,,=  f,,+^  > 

where  the  increments  are  tte  solutions  of 


(4.18) 


J^L 


U.1 


2*-\ 


+2IZ 


5  =  2. 
j^u. 


=  0 


for  u+j,  u, j=2,3, - • -,2t-l  . 


Addition  of  a  suffix  1  to  Pu,Pj  indicates  replacement  by 
_ _ _ 

PU1>  after  differentiations,  and  further  each  term  of  (4.l8)  is 

given  as  follows: 


(^•19) 


Tlu. 

P«, 


y 


(4.20) 


(4.21) 


(4.22) 


:-z 

'  nu  Ni  'l 

Zr  (r?j 

>  i 

_ 

-z 

WQj?**]} 

Ni 

'V  - 

VR,^, 

?*m.  _ 

/ 

:  0 

j  e  (Z?u)  . 

An  iterative  process  may  be  based  on,  2t-2  equations  shown  by  (4.l6), 

replacing  Pu^,P^  by  ^>U2,'P12  anc^  solving  for  increments  6P  „,  6?" 

U.2  J  2 
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and  so  on  until  a  satisfactorily  close  approach  to  'p  ,*P  is  achieved, 

^  J 

Thus  we  obtain  the  individual  estimates  of  p“uv  by  applying  (4.l6)  . 


Theorem  5  The  necessary  and  sufficient  condition  for  p  to  be 
estimable  is  that  any  observation  space  is  at  least  partially  asso¬ 
ciated  to  one  or  several  common  cells.  In  other  words,  it  is  the  condi 
tion  that  each  observation  space  is  somewhere  overlapping  another. 


Proof :  The  readers  would  feel  that  this  theorem  is  natural.  (Neces¬ 

sity)  Suppose  that  t  observation  spaces  are  obtained  independently 
and  are  separated  to  s  connected  spaces  in  a  sense  of  overlap.  Let 
a  total  number  of  their  cells  be  k  •  Then,  since  the  sum  of  the  pro¬ 
babilities  in  cells  becomes  one,  k-i  probabilities  must  be  linearly 
independent . 

Suppose,  on  the  other  hand,  we  are  given  s  parameter  spaces  each 
of  which  corresponds  to  each  of  s  connected  observation  spaces.  Then 
the  number  of  linearly  independent  parameters  in  each  parameter  space 
is  less  by  one  than  the  number  of  cells  in  the  space.  Hence,  there 
exist,  at  most,  k-s  linearly  independent  parameters  altogether.  So 
we  have  s-1  degrees  of  freedom  to  estimate  the  probabilities  and  we 
cannot  obtain  uniquely  the  k  parameters.  Prom  this  we  conclude  that 
s  should  be  1 


(Sufficiency)  By  using  the  above  notations,  if  s=l,  then  we  are 
indeed  able  to  obtain  the  estimates  of  all  p  »s  as  shown  in  Theorem 

4.  (Q.E.D.) 


5-  Certain  typical  cases  In  generalization 


Concerning  certain  special  types  of  generalization,  let  us  give 
some  explicit  estimates  of  Puv's  as  colloraries  of  Theorem  4. 


5 *  1  Let  us  consider  an  estimation  problem  where  the  observation 
spaces  form  a  sequence  of  nested  spaces,  such  as  =  £?, l92)-OQt 
and  this  is  corresponding  to  a  generalization  of  section  2,  (cf.  Fig. 2). 


- n — 

2 

1 

s?  ■» 

st? 

£ 

t-2 

Fig.  2 

In  this  case,  the  decompositions 


'  nt  i  u-  >  -  5. 

o 

{ of  SJ  are  defined 


as  follows: 

(5-D  =  0(Qir,Qt,)  =Q  ; 

where  we  put  and  values  of  u  equal  to  those  of  i  .  And 

when  Puv*s  are  denoted  probabilities  of  cells  in  c 0  ,  v=l , 2, . . . ,L  ,  we 
obtain  the  following  Collorary  1. 


Collorary  1  The  combined  estimates  of  the  puv's,  u=l,2,...,t  and 

v=l ,2, . . . , lu,  are  obtained  explicitly  by  the  maximum  likelihood  estima¬ 
tion  as  follows: 


(5-2) 


t5  : 

'uv 


71 


uv 


Tl£ 


for  all  V€(0u,u=l,2,  .  .  .,t. 


T-0  tOr 
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where  we  define  u>0  =  <£>  and  'p'  =  Q.  Furthermore,  these  estimates  are 

also  unbiased,  consistent  and  sufficient  as  in  Theorem  2. 

Indeed,  we  can  obtain  the  explicit  estimates  of  Puv's  by  represent¬ 
ing  successively  the  above  formula  (5.2)  through  u=l  . 

* 

For  example,  in  case  t=3,  we  obtain  as  follows: 


(5.3) 

(5.4) 


for  it  e  uJ1  } 


Vj.e  loz 

> 


and 


(5-5) 


(3) 

71vrs 


H. 


vi(h 


M, 


1  + 


for 

The  latter  half  of  this  corollary  is  proved  by  quite 
manner  as  in  Theorem  2  excepting  the  following  likelihood 
applied  in  place  of  L  and  Lq  .given  by  (2.1)  and  (2.9) 


V,^3 

the  same 
functions  are 
in  the  previous 


theorem  respectively, 


(5-6) 


L  =  TT 

j=t 


No! 


mIT 


ft 


71? 


S  &}**■ 
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5-2  Let  us  consider  an  estimation  problem  in  case  when  the  observation 
spaces  are  linked  like  a  chain,  and  this  case  is  corresponding  to  a 


generalization  in  chapter  6  of 

- - 

Li  [5] 

(c.f.  Pig. 

3). 

* 
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.  i 
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1 _ 
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1 

l 

Pig.  3  * 


In  this  case,  the  decompositions  of  are  expressed  by- 

using  conventional  double  suffix  in  place  of  { ouu]  as  follows: 


(5.8) 


=  R-Wu-U).,  , 
where  we  define  =  4> 


U}.3=  , 

fcr  i  =  »,2;— ,t  , 


Furthermore,  let  Pi ^ '  s  be  partial  sums  of  Puv's  on  LL^jj  then 


Pu's  are  corresponding  to  P^  1  s  80 


2t-l  L 


(5-9) 


t  3 

>  y  f.  =  i 

Myr')  ’ 


U  =  1  v=(  ,llv  U  =  t 

where  Pi  1  =  P1_1  3  for  1=2,3, ...jt  .  Then  we  obtain  the  following 
Corollary  2  by  using  Theorem  4. 


© 
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Corollary  2  The  combined  estimates  of  the  p  »s,  u=l,2,...,t  and 


v=l,2,  .  .  . ,  ,  are  obtained  explicitly  as  follows: 


C  5.10) 


LOaii') 


^u.'o 


Tlu,r  /\ 


for  u=l ,2, . .  ,2t-l 
and  v=l  ,2,  .  .  , 


(fU) 


C^-12) 


1  mi  _ i  _ 

Ni  i  4- jC  <3  (yn^) 


-  nVr,;, 

If  =  2.  1 


T~  n*  • n* 

■<-  2  1  i) 


/  '  /X 

?  =? 

I  11  la^-3 


L\  X, 


where  11,/,  = 


wa*>.  J 


1  i  ^  2.  t 


These  estimates  are  also  unbiased,  consistent 


and  sufficient. 


For  example.  In  case  t=2,  we  obtain  simply 


-p )  _  T.Mp2t  -Q  _  Yllz  n2| 

'  t,*  nf,  -+-  n*hti  -i  ^  ^  Vi*  vu,  ■+-  n*  -t-  n* 


(sr.13) 


A  /N 

T3  =  I  -T?  -P2  . 

The  proof  of  the  latter  half  of  this  corollary  may  be  omitted, 
because  the  principle  Is  quite  the  same  as  before  except  for  a  certain 


complication . 
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